Instance Normalization: The Missing Ingredient for Fast Stylization

نویسندگان

  • Dmitry Ulyanov
  • Andrea Vedaldi
  • Victor S. Lempitsky
چکیده

It this paper we revisit the fast stylization method introduced in Ulyanov et al. (2016). We show how a small change in the stylization architecture results in a significant qualitative improvement in the generated images. The change is limited to swapping batch normalization with instance normalization, and to apply the latter both at training and testing times. The resulting method can be used to train high-performance architectures for real-time image generation. The code will be made available at https://github.com/DmitryUlyanov/texture_nets.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Exploring the structure of a real-time, arbitrary neural artistic stylization network

In this paper, we present a method which combines the flexibility of the neural algorithm of artistic style with the speed of fast style transfer networks to allow real-time stylization using any content/style image pair. We build upon recent work leveraging conditional instance normalization for multi-style transfer networks by learning to predict the conditional instance normalization paramet...

متن کامل

Normalization Regarding Non-Random Missing Values in High-Throughput Mass Spectrometry Data

We propose a two-step normalization procedure for high-throughput mass spectrometry (MS) data, which is a necessary step in biomarker clustering or classification. First, a global normalization step is used to remove sources of systematic variation between MS profiles due to, for instance, varying amounts of sample degradation over time. A probability model is then used to investigate the inten...

متن کامل

G-Strokes: A Concept for Simplifying Line Stylization

In previous systems, only very few line properties have been used for stylization in line rendering. This is due to a complicated handling and two-way dependency of these properties and the stages of the stylization pipeline. In this paper we propose the concept of G-strokes to efficiently deal with these and many more stroke properties. This new concept allows a much simpler way of representin...

متن کامل

Piecewise linear stylization of pitch via wavelet analysis

In this paper, we propose a wavelet analysis based piecewise linear stylization of the pitch trajectory. We also address the often-faced difficulty in handling the tradeoff between mean squared error and the number of lines used for fitting, where a heuristic approach is typically used to make the stylization choice. We pose the piecewise linear stylization task as a minimization problem by def...

متن کامل

Reality Tooning: Fast Non-Photorealism for Augmented Video Streams

Recently, we have proposed a novel approach to generating augmented video streams. The output images are a non-photorealistic reproduction of the augmented environment. Special stylization methods are applied to both the background camera image and the virtual objects. This way, the graphical foreground and the real background images are rendered in a similar style, so that they are less distin...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • CoRR

دوره abs/1607.08022  شماره 

صفحات  -

تاریخ انتشار 2016